Establishing Applicability of SSDs to LHC Tier-2 Hardware Configuration

نویسندگان

  • Samuel C. Skipsey
  • Wahid Bhimji
  • Mike Kenyon
چکیده

Solid State Disk technologies are increasingly replacing high-speed hard disks as the storage technology in high-random-I/O environments. There are several potentially I/O bound services within the typical LHC Tier-2 in the back-end, with the trend towards many-core architectures continuing, worker nodes running many single-threaded jobs and storage nodes delivering many simultaneous files can both exhibit I/O limited efficiency. We estimate the effectiveness of affordable SSDs in the context of worker nodes, on a large Tier-2 production setup using both low level tools and real LHC I/O intensive data analysis jobs comparing and contrasting with high performance spinning disk based solutions. We consider the applicability of each solution in the context of its price/performance metrics, with an eye on the pragmatic issues facing Tier-2 provision and upgrades International Conference on Computing in High Energy and Nuclear Physics (CHEP) 2010 Taipei, Taiwan

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ScotGrid: Providing an Effective Distributed Tier-2 in the LHC Era

ScotGrid is a distributed Tier-2 centre in the UK with sites in Durham, Edinburgh and Glasgow. ScotGrid has undergone a huge expansion in hardware in anticipation of the LHC and now provides more than 4MSI2K and 500TB to the LHC VOs. Scaling up to this level of provision has brought many challenges to the Tier-2 and we show in this paper how we have adopted new methods of organising the centres...

متن کامل

Cost Effective Storage using Extent Based Dynamic Tiering

Multi-tier systems that combine SSDs with SAS/FC and/or SATA disks mitigate the capital cost burden of SSDs, while benefiting from their superior I/O performance per unit cost and low power. Though commercial SSD-based multi-tier solutions are available, configuring such a system with the optimal number of devices per tier to achieve performance goals at minimum cost remains a challenge. Furthe...

متن کامل

Virtual Environments for Prototyping Tier-3 Clusters

The deployed hierarchy of Tier-1 and Tier-2 data centers, as organized within the context of the Worldwide LHC Computing Grid (WLCG), have without question been exceedingly successful in meeting the large-scale, group-level production and grid-level data analysis requirements of the experiments in the first full year of LHC operations. However, the plethora of derived datasets and formats thus ...

متن کامل

Evaluating the impact of SSDs and InfiniBand in Hadoop cluster performance and costs

T his report evaluates the impact in terms of performance and costs of introducing Solid State Drives (SSDs) and InfiniBand networking technologies, over a typical commodity Hadoop cluster setup for Big Data processing. For the evaluations, over 1,000 benchmark runs are executed to the same Hadoop cluster, but varying the software (SW) configuration to find the best performance of a particular ...

متن کامل

Unified storage systems for distributed Tier-2 centres

The start of data taking at the Large Hadron Collider will herald a new era in data volumes and distributed processing in particle physics. Data volumes of hundreds of Terabytes will be shipped to Tier-2 centres for analysis by the LHC experiments using the Worldwide LHC Computing Grid (WLCG). In many countries Tier-2 centres are distributed between a number of institutes, e.g., the geographica...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1102.3114  شماره 

صفحات  -

تاریخ انتشار 2010